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o information showing start position capable of 
processing data or not 

♦ Flag for random access (Random access flag), 
e.g. Intra-frame (I -picture) in the case of 
picture 

• Flag showing access unit (Access flag) , 
e.g. Frame in the case of picture, GOB unit 



AL : Adaptation layer 
ES : Elementary stream 
PTS • Presentation* time* stamp 



Header 
information 
of data 



Data (Picture or sound for each frame) 




• Information showing start position capable of 
processing data or not 

• Information showing data reproducing time (PTS) 

• Information showing data processing priority 
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oTS.-Transport stream(Transmission packet) 






Communication 
header 



AL 



ES 



• Information showing start position capable of processing 
pieces of data or not 

• Identification number for showing data sequence(Sequence 
number) 

. * Time concerned with transmission of pieces of data 



o Handling time stamp and marker bit 



(b) 



(d) 



(a) 


Communication 
header 


AL 


ES 




t 

Time stamp 


i 



PTS or not (Additional) 



Communication 
header 

¥ 



AL 



T 



ES 




Time stamp for 

communication 

header 



Time stamp PTS or not (Additional) 



(c) 


Communication 
header 


AL 


ES 




t — - 







MarkerBit 



Substituted by 
AL flag (Additional) 



AL 



ES 




MarkerBit of 

communication 

header 



Communication 
header 

— f 

MarkerBit 

(It is interpreted that random access flag 
and access flag are present in AL.) 
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H.223 or 
the like 




Data and 

control information 



UDP/TCP/RTP 













Intra- net and inter-net 

or the like 



i 
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Broadcast program transmitting procedure 

<Broadcast type and communication type including return channel) 
Transmitting side Receiving side 

Transfer of data structure 
(LCN O) 



ACK/Reject 



(*1) 



Transfer of corresponding data 
(From each port) : (*2) 



Are processing and 
reception possible? 
, Start decoding of 
data which can be 
decoded and display 
it. 



<Broadcast type (with no return channel)) 

Transmitting side Receiving side 

Transfer of program 
information and data structure 
(LCN O) : UDP(*3) 



Transfer of corresponding data 
(From each port) : UDP 



(*1 ) Must be a system for detecting and retransmitting a packet 

loss like TCP. 
(*2) RTP/RTCP or TCP/IP 

(*3) Same data (picture or sound) or control information (broadcast 
program or data structure) is continuously repeatedly 
transmitted. A packet is detected and sequence is kept at a 
receiving terminal in accordance witha sequence number. (To be 
used in a local closed region. Traffic becomes too large.) 
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F i 
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1 O ( a ) 



Control information 
or data 



Program or data 
to be required 



Flag, counter, 
or timer showing 
point of time to be 
required 



Receiving terminal 



Main 

looking-listening 
section 



Auxiliary 
looking-listening 
section 




Storing 
section 



Output 
section 



Fie. 1 O ( b ) 



Control information 
or data 



Receiving terminal 



Main 

looking-listening 
section 



Caption 
broadcast-program 
receiving section 



Output 
section 



Storing 
section 
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i s m . 11(a) 



hierarchical image of object> 




<Transmission image of object > 
< 1 . Broadcast type > 




<2 • Communication type> 

RTP/RTCP (Program ID of each logical 



channel is fixed. ) 









Terminal 


«C 


> 


Terminal 


A 


< 


3* 


B 









LCNO (control) 



F i 



11(b) 
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•Capability exchange definitions(original from H.245) 



Terminal CapabilitySet 
{ 

sequenceNumber 



::=SEQUENCE 
SequenceNumber, 



multiplexCapability 
capability Table 

capabilityDescriptors 
mpeg4Capability 



MultiplexCapabilityOPTIONAL 
SET SIZE0..256) OF Capability 
TableEntryOPTIONAL, 
SET SIZEC1.-.256) OF Capability 
DescriptorOPTIONAL, 
MPEG4Capability0PTI0NAL. 



} 



i 



1 2 
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— MPEG4 Capability definitions 



MPEG4Capability 



sequenceNumber 

NumberOfProcessObject 

{ 

MaxNumberOf Video 
MaxNumberOf Sounds 
MaxNumberOfMux 

} 

reconfigurationALCapability 



} 



MPEG4CapabilityAck 



sequenceNumber 



} 

MPEG4CapabilityReject 
{ 

sequenceNumber 
NumberOfProcessObject 

maxNumberOf Video 

maxNumberOf Sounds 

MaxNumberOfMux 

} 

reconf i gurationALCapability 



::=SEQUENCE 

SequenceNumber, 
SEQUENCE 

INTEGER(0..1023), 
INTEGER(0..1023), 
INTEGER(0..1023), 
BOOLEAN, 

::=SEQUENCE 
SequenceNumber, 

::=SEQUENCE 

SequenceNumber, 
SEQUENCE 

MaxNumberOf Video, 

MaxNumberOf Sounds 
maxNumberOf Mux, 
BOOLEAN, 
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*r i gr . 13(a) 



—Group MUX definitions 



CreateGroupMux 
{ 

sequenceNumber 

GroupMuxID 
lanportNumber 

} 

CreateGroupMux Ack 



} 



sequenceNumber 



CreateGroupMuxReject 
{ 

sequenceNumber 

cause 

{ 



::=SEQUENCE 

SequenceNumber, 

INTEGER(0..1023), 
LANPortNumber, 



::=SEQUENCE 
SequenceNumber, 

::=SEQUENCE 

SequenceNumber, 
CHOICE 
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3^ i S . 13(b) 

DestoryGroupMux 
I 

sequenceNumber 
GroupMuxID 

} 

Dest or y Group Mux Ack 

{ • 

sequenceNumber 
} ' 

Destor y Group MuxReject 
{ 

sequenceNumber 

cause 

{ 

} 

} 



::=SEQUENCE 

SequenceNumber, 
INTEGER(0..1023), 

"SEQUENCE 
SequenceNumber, 

::=SEQUENCE 

SequenceNumber, 
CHOICE 



18/57 
i & . 13(c) 

PortNumberStructure 
I 

sequenceNumber 
lanPortNumber 
numberOf LogicalNumber 



::=SEQUENCE 

SequenceNumber, 
LANPortNumber, 
INTEGER(1..15), 
SEQUENCE SIZE0..15) OF PortStructureElement, 



) - 

PortStructureElement 
{ 

logicalPortNumber 



::=SEQUENCE 
LogicalPortNumber, 



Po'rtNumberStructureAck 
{ 

sequenceNumber 

} 

PortNumberStructureReject 
{ 

sequenceNumber 

cause 

{ 



—SEQUENCE 
SequenceNumber, 

."SEQUENCE 

SequenceNumber, 
CHOICE 
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1 4 



—Logical channel signalling definitions(original from H.245) 
-MPEG4 Object Create Operation(for LANPortNumber) 



OpenLogicalChannel ::=SEQUENCE 

fowardLogicalChannelNumber LogicalChannelNumber, 

fowardLogicalChannelParameters SEQUENCE 

* portNumber INTEGER(0..65535)OPTIONAL, 
dataType DataType, 
multiplexParameters CHOICE 

h222LogicalChannelParameters H222LogicalChannelParameters, 
h223LogicalChannelParameters H223LogicalChannelParameters, 
v76LogicalChannelParameters v76LogicalChannelParameters, 

h2250LogicalChannelParameters H2250LogicalChannelParameters, 
h223AnnexALogicalChannelParameters 
H223AnnexALogicalChannelParameters 
MPEG4LogicalChannelParameters MPEG4LogicalChanelParameters, 



• • • r 



} 



. . . , 



i 



1 S 
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MPEG4LogicalChannelRarameters ::=SEQUENCE 



{ 

-H.225BASE 
LANportNumber 
ProgramID 
ProgramName 

} • 

BroadcastChannelProgram 



{ 



sequenceNumber 
numberOfChannetNumber 



INTEGER(0.. 65535), 
INTEGER(0..255), 

0CTETSTRING(SIZE(128)), 



::=SEQUENCE 

SequenceNumber, 
INTEGER(0..1023), 



SEQUENCE SIZE(U023) OF MPEG4LogicalChannelParameters 



} 

ChangeLogicalChannelAttribute 

sequenceNumber 

lanportNumber 

ProgramID 

} 

ChangeLogicaLChanneLAttributeAck 
{ 



sequenceNumber 



} 

ChangeLogicalChanneLAttributeReject 

sequenceNumber 

cause 

{ 



::=SEQUENCE 

SequenceNumber 
LANPortNumber, 
INTEGERC0..255), 



::=SEQUENCE 
SequenceNumber, 

::=SEQUENGE 

SequenceNumber, 
CHOICE 



2 1/57 
Fig. 16(a) 



•MPEG4 Object Class definition 



MPEG4 Object Class definition 



{ 



sequenceNumber 
ProgramID 

Number Of Object sList 
SEQUENCE SIZE0..1O23) OF 



Ob jectStructureElement 
I 

SSRC 

LANPortNumber 

O 

ScrambleFlag 
CGDOffset 
MediaType 



:i=SEQUENCE 

SequenceNumber, 
INTEGER(0..255), 
INTEGER(0..1023), 
ObjectStructureElement 

::=SEQUENCE 

INTEGER(0..16777215), 
INTEGER002.4.5000), 

— forRPT(Video&Sound.) 
BOOLEAN, 
INTEGER(0..255), 
INTEGER(0..255), 



} 



MPEG4 Object Class def initionAck 



{ 



} 



sequenceNumber 



{ 



sequenceNumber 

cause 

{ 



::=SEQUENCE 
SequenceNumber, 



MPEG4 Object Class definitionReject ::=SEQUENCE 



SequenceNumber, 
CHOICE 



F- i s . 
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-Adaptation Layer Reconfiguration Request definitions 



ALReconfiguration 



{ 



sequenceNumber 
ReindomAccessFlagMaxBit 
PresentationTimeStampsMaxBit 
CGDPriorityMaxBit 



::=CHOICE 

SequenceNumber, 
INTEGERC0...2), . 
INTEGER(0...32). 
INTEGER(0...8), 

--forVideo and Sound 



-Adaptation Layer Reconfiguration Response definitions 



ALReconf igurationAck 



{ 



sequenceNumber 



} 

ALReconf igurationReject 
{ 

sequenceNumber 

cause 

{ 



::=SEQUENCE 
SequenceNumber, 

::=SEQUENCE 

SequenceNumber, 
CHOICE 



} 

<Relation between AL, ES, and RTP> 
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i & . 1 T 



—Setup Program and Data Request definitions 



Setup Request 



{ 



sequenceNumber 
SSRC IMEGERCO.. 16777215)2^32, 



:: = CHOICE 
SequenceNumber, 



Logical Channel Number, 
setupitem 

executeProgramN umber 
dataNumber 

executeCommandNumber 

not itycounter 
{ 



flag 

counter 
timer 



INTEGER(1024...5000), 
CHOICE 

INTEGERC0...255), 
INTEGERC0...255), 
INTEGER(0...255), 

CHOICE 

BOOLEAN 

INTEGER(0...255), 
INTEGER(0...255), 



2 4/57 

Fig. IS 



—control and AL attribute definitions 



ControlALdefinition ::=CHOICE 
{ 

sequenceNumber SequenceNumber, 

AL CHOICE 

{ 

RandomAccessFlagllse BOOLEAN, 
PresentationTimeStampUse BOOLEAN, 

CGDPriorityUse BOOLEAN, 
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Fie. 19(a) 



classES_header{ 

uint(4) headerlD; 

ui nt(24) bufferSizeES; 

uint(1) useTimeStamps; 



u i nt ( 16) sequenceNumberMaxBit; 
u i nt ( 1 ) useHeaderExtension; 
if (useHeaderExtension)l 

uint(1) accessUintStartFlag; 

uint(1) randomAccessPointFlag; 

uint(l) OCRsetFlag; 

u i nt (4) degradationPriorityMaxBit; 

uint(3) reserved: 

} 
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i & . 19(b) 



-Adaptation Layer PDU header configuration Request and Command definition 



AL configuration 



{ 



sequenceNumber 
defaultHeaderConfiguration 

header ID 

MPEG4ALPDUHeaderConfig 



{ 



accessUintStartFlag 

randomAccessPointFlag 

OCRsetFLag 

degradationPriorityMaxBit 



::=SEQUENCE 

SequenceNumber, 
BOOLEAN, 
INTEGER(0..4), 
SEQUENCE 

BOOLEAN, 
BOOLEAN, 
BOOLEAN, 
INTEGERC0..4), 



r 
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Processing at receiving terminal under overload(Common to dynamic 
picture and sound) 

Thread for processing sound at system level is previously set it's 
processing priority to a value higher than that of thread for 
processing picture. 



Frame_skipped 
. =FLASE 



Set priority of 

frame to be 
disused to value 

larger than 
(CutOffPriority) 
"maxPriority". 



SteplOI 
Value of resolution of 
priority to be added to 
frame, CGDoffset(Can be 
determined in accordance 
with receiving-terminal 
performance) is transmitted 
as control information. 

Step 103 



Step 102 




CutOffP.riority=0 



CutOffPriority 
=maxPriority 



Step 104 



Frame_skipped=TRUE 
and frame type=P frame 



Frame priority+(CGDoffset) 
^ CutOffPriority 

YES 



YES 



Frame_skipped=FLASE 



I 



Frame_skipped 
=TRUE 



Deliver data to decoder. 
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2 T( a ) 



4031 



4032 



/ 




/ 




Priority adding 








Priority deciding 






section 








section 











4101.4201 Picture-sound encoder 

4102,4202 Picture-sound decoder 



f i e . 2 7" ( b ) 




Communication header Payioad 

(Divided data) 
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RTP header 



H.263 payload header 



H.263 bitstream 



o Mode A: GOB, picture boundary 

Presence or absence of mode or PB, start 
and end positions of bit stream, and 
execution timing states of options of 
resolution, frame type> and H.263 



Core 
infor- 
mation 



To be set when 
PB frame is present 



DBQU ANT, TR(f or B frame), _ 
TR(for P frame) 

o Mode B: MB boundary without PB 

Core information for Mode A 

Information for quantization value (GQUANT) , GOB number, 
absolute address of first MB in GOB, and movement vector 
(Horizontal and vertical directions) 



oMode C: MB boundary with PB 

Information for Mode B 

DBQUANT,TR(for B f rame),TR(f or P frame) 



Relating of communication payload 

Mode A + Layer No- + * elat ? d 

descrip- 



Tr ansmi 1 1 ing - 
side terminal 



tion 



Configuration information 



Receiving- 
side 

terminal 



T 5 * i S . 
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Data 



Priority at application level 



Dividing 
of data 



Data 



Data 



StreamPriority 
FramePriority 



Relating 



Priority in IP level 



Priority of IP 



Priority in data 



Available range 



StreamPriority 


0 - 


~ 3 


FramePriority 


0 - 


- 5 


IPV6 


8 - 


~ 15 



[0 
- [8 



( Lowe st) ( Maximum 
priority) 



15] 

Mapping of part 

15] 
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Start 



801 



Input picture. 




Intra 




Movement 
compensation 




i 


* 

i 


x805 


DCT 









804 



VLC 




YES 



Generate and multiplex 
data string. 



808 



4 X 
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Start 

2 

Initialize execution 
time (a_i) of each 
element. 



• Input multiplexed 
data and measure time 
required to input 
multiplexed data. 



I 



Output variable-length 
code and data string. 



Fetch execution 
frequency from data 

string and set 
execution frequency 
to x i. 



Calculate execution 
frequency in 

accordance with x i 

and a. 



i. 



J. 



901 



902 



Start of decoding routine 



903 
904 



905 



Start time 
measurement, 



To decoding 
routine 



906 



907 




IDCT 



910 
911 




Intra 



Movement 
compensation 



914 



Complete time 
measurement. 



NO 
908 



Estimate execution 
time of each element 
an d update a_i. 

I 



909 



Processing 
of every macroblock 
completed? 

YES 



End of decoding routine 



5 2/57 



4- 2 



1004 



Receive data string 
and fetch and set 
execution time of 
each processing. 



808 



Generate and 
multiplex data 
string. 



Start 

9 

Initialize each 
execution time. 



3 



Input picture. 



± 



Divide macroblock. 



Decide intra/inter on 
every macroblock. 



Decide execution 
frequency. 



1001 

801 
/802 
/1002 
1003 




804 



Movement 
compensation 

I 



DCT 
HZ 



VLC 



805 
806 



807 



NO 



Processing 
"of every macroblock^ 
completed? 



YES 



4 3 



-1101 



Start 

SL 



Intialize execution 
time a_i of each 
processing. 



Jl 



Input frame rate. 



1102 



I 



1104 



Estimate 
execution time of 
each processing 
and update a i. 



808 



Generate and 
multiplex data 
string. 
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Input picture. 



801 



Divide macroblock. 



I 



-802 



Decide intra/inter on 
every macroblock. 



1002 



Decide execution 
frequency. 

i ~ 



Start execution 
time measurement. 



1103 



1105 




Intra 



804 



Movement 
compensation 

I 



DCT 



VLC 



805 
806 
807 



Processing 
'of every macroblocR; 
completed? 

YES 



End execution 
time measurement. 
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5001 



Transmitting 
means 




5002 
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^ i & . ^ 5 





Receiving 
means 








Transmitted 
information 
interpreting 
means 








Storing means 





5101 



5102 



5103 
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